Construct Validity Hypotheses Research Articles

Construct validity, responsiveness and minimal important difference of the cumulated ambulation score in older adults with hip fracture in sub-acute rehabilitation facility.

To assess the construct validity, responsiveness and minimal important difference of the cumulated ambulation score in patients with hip fracture in sub-acute rehabilitation facility. Observational, prospective, monocenter, cohort study. Rehabilitation Institute. 456 older adults with hip fracture (≥65 years) admitted for inpatient rehabilitation. Cumulated ambulation score, functional independence measure and functional ambulation category were collected at admission and discharge. Construct validity and responsiveness were assessed through hypothesis testing and minimal important difference was determined using the anchor-based method; floor and ceiling effects were also assessed. The cumulated ambulation score showed strong correlations with the functional independence measure and functional ambulation category scores at both admission and discharge, satisfying all the hypotheses for construct validity. The effect size of cumulated ambulation score was 1.63. Changes in cumulated ambulation score had a moderate-to-strong correlation with changes of other instruments and were able to discriminate patients improved from those not-improved, and patients classified as independent ambulators from those dependent. A ceiling effect was found only at discharge. The estimated minimal important difference was 2 points. The cumulated ambulation score showed high levels of construct validity and responsiveness according to the hypothesis testing. A two points improvement at the end of rehabilitation was found to be clinically important in people with hip fracture in the sub-acute phase. The ceiling effect found at discharge suggested the limitation of the scale in assessing people with a partially recovered autonomy in performing postural changes and gait.

TENDINopathy Severity assessment–Achilles (TENDINS-A): evaluation of reliability and validity in accordance with COSMIN recommendations

ObjectiveTo evaluate the construct validity (structural validity and hypothesis testing), reliability (test–retest reliability, measurement error and internal consistency) and minimal important change (MIC) of the 13-item TENDINopathy Severity assessment–Achilles (TENDINS-A).MethodsParticipants...

Cross-cultural validation of two scales to assess mental wellbeing in persons affected by leprosy in Province 1 and 7, Nepal.

To assess mental wellbeing among persons affected by leprosy, this study aimed to validate the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS) and the Patient Health Questionnaire (PHQ-9, depression tool) in Province 1 and 7, Nepal. Using purposive and convenience sampling, cross-cultural equivalences were assessed through semi-structured interviews with persons affected by leprosy (>18 years). Data were transcribed, translated, analysed and discussed with experts before revising the tools. Psychometric properties of the scales were assessed using an interviewer-administered questionnaire with cases affected by leprosy and controls not affected by leprosy (>18 years). Statistical analysis included internal consistency, construct validity, floor and ceiling effects, and interpretability. The qualitative study included 20 respondents of whom eleven were female. The statements in the original tools were rephrased to questions as participants had difficulties understanding the statements. Six additional changes were made to ensure items were understood well. The quantitative study included 90 cases (46% female) and 50 controls (54% female). The WEMWBS and PHQ-9 had adequate psychometric properties. Cronbach's alphas were 0.85 and 0.76, respectively, indicating good internal consistency, 75% of hypotheses for construct validity were confirmed, no floor and ceiling effects were found, and data to help users interpret results are presented. Our study provides evidence that the adapted versions of the WEMWBS and PHQ-9 have good cultural validity to measure mental wellbeing and depression among persons affected by leprosy in Province 1 and 7, Nepal.

Translation and Psychometric Evaluation of the University of Jyvaskyla Active Aging Scale (UJACAS) for Use in Sweden

The objectives were to translate the University of Jyvaskyla Active Aging Scale (UJACAS) to Swedish, to establish semantic equivalence and evaluate psychometric properties for use among persons 55 years and older in Sweden. The UJACAS contains 17 items to be self-assessed regarding goals, abilities, opportunity, and activity. Psychometric properties content validity, data quality including floor and ceiling effects, test-retest reliability, internal consistency, and construct validity were evaluated with different samples in three phases, using state-of-the-art statistics. After translating and establishing semantic equivalence, content validity was assessed as high. With ICC = 0.88 (95% CI 0.80–0.93) test-retest reliability was moderate. Internal consistency was high (Cronbach alpha = 0.84–0.91), and 84% of the questions reached the cut-off value of 0.3 for corrected item-total correlation. Construct validity hypotheses were confirmed. Results indicate that the UJACAS is reliable and valid for use among persons 55 and older in Sweden.

Measurement properties of the Dutch versions of QuickDASH and PRWHE in patients with complaints of hand, wrist, forearm and elbow.

The shortened version of the Disabilities of the Arm, Shoulder and Hand (QuickDASH) and Patient Rated Wrist/Hand Evaluation (PRWHE) are commonly used questionnaires to assess patient-reported hand function. Information about the measurement properties of the Dutch versions is scarce. To gain insight into the measurement properties of the Dutch language versions of the QuickDASH and the PRWHE in patients with (non)specific complaints of the hand, wrist, forearm and elbow. Internal consistency, construct validity, test-retest reliability, responsiveness, and floor and ceiling effects were assessed according to COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) recommendations. Questionnaires were filled out by 132 patients. Internal consistency of QuickDASH (Cronbach's α= 0.92) and PRWHE (Cronbach's α= 0.97) was high. Predefined hypotheses for construct validity were not confirmed for 75% for both QuickDASH and PRWHE (accordance with 62% of predefined hypotheses for both questionnaires). Test-retest reliability of QuickDASH (ICC = 0.90) and PRWHE (ICC = 0.87) was good. Both QuickDASH (AUC = 0.84) and PRWHE (AUC = 0.80) showed good responsiveness. No floor or ceiling effects were present. Measurement properties of the Dutch language versions of the QuickDASH and the PRWHE, applied to patients with (non)specific complaints of the hand, wrist, forearm and elbow, were very similar. Test-retest reliability and responsiveness were good for both QuickDASH and PRWHE. Construct validity could not be demonstrated sufficiently.

Psychometric properties of the Chilean version of the quality of life questionnaire for multiple myeloma.

To evaluate the internal consistency and construct validity of the QLQ-MY20 for assessing the quality of life in multiple myeloma survivors in Chile. This was a cross-sectional study conducted between March 2020 and December 2022. It involved 118 individuals from two public hospitals. The QLQ-C30 and QLQ-MY20 questionnaires were used. Internal consistency was assessed using Cronbach's alpha(α), and construct validity was evaluated through hypothesis testing (Mann-Whitney and Spearman correlation). The average age of participants was 67.2 years (SD=9.2). Internal consistency for the complete scale was α=0.779, for the "disease symptoms" dimension α=0.671, for the "side effects of treatments" dimension α=0.538, and for the "future perspective" dimension α=0.670. Four of the five construct validity hypotheses were confirmed: women, individuals with worse performance status, those with pain, and those with worse fatigue showed more symptoms. The Chilean version of the QLQ-MY20 demonstrates adequate internal consistency and construct validity.

Assessing independence in mobility activities in trauma care: Validity and reliability of the Activity Independence Measure-Trauma (AIM-T) in humanitarian settings.

The importance of measuring outcomes after injury beyond mortality and morbidity is increasingly recognized, though underreported in humanitarian settings. To address shortcomings of existing outcome measures in humanitarian settings, the Activity Independence Measure-Trauma (AIM-T) was developed, and is structured in three subscales (i.e., core, lower limb, and upper limb). This study aimed to assess the AIM-T construct validity (structural validity and hypothesis testing) and reliability (internal consistency, inter-rater reliability and measurement error) in four humanitarian settings (Burundi, Iraq, Cameroon and Central African Republic). Patients with acute injury (n = 195) were assessed using the AIM-T, the Barthel Index (BI), and two pain scores. Structural validity was assessed through confirmatory factor analysis. Hypotheses were tested regarding correlations with BI and pain scores using Pearson correlation coefficient (PCC) and differences in AIM-T scores between patients' subgroups, using standardized effect size Cohen's d (d). Internal consistency was assessed with Cronbach's alpha (α). AIM-T was reassessed by a second rater in 77 participants to test inter-rater reliability using intraclass correlation coefficient (ICC). The results showed that the AIM-T structure in three subscales had an acceptable fit. The AIM-T showed an inverse weak to moderate correlation with both pain scores (PCC<0.7, p≤0.05), positive strong correlation with BI (PCC≥0.7, p≤0.05), and differed between all subgroups (d≥0.5, p≤0.05). The inter-rater reliability in the (sub)scales was good to excellent (ICC 0.86-0.91) and the three subscales' internal consistency was adequate (α≥0.7). In conclusion, this study supports the AIM-T validity in measuring independence in mobility activities and its reliability in humanitarian settings, as well as it informs on its interpretability. Thus, the AIM-T could be a valuable measure to assess outcomes after injury in humanitarian settings.

Development of the Workplace Interpersonal Problems Scale for Care Workers (WIPS) and examination of its reliability and validity

IntroductionThe turnover rate of care workers has remained high by global standards, with previous studies showing an association between workplace interpersonal relations and care worker turnover and turnover intentions. This study details the development of the Workplace Interpersonal Problems Scale for Care Workers (WIPS) and examines its reliability and validity according to the COSMIN guidelines. MethodsA total of 476 care workers employed by elder care facilities participated in the study. This study examined the reliability and validity of the WIPS after its development. Reliability was evaluated using Cronbach's α, test reliability with the standard error of measurement, and test–retest reliability with the intraclass correlation coefficient. Content validity, construct validity, and structural validity were examined to evaluate validity. ResultsBoth total and subscale scores of the WIPS had a Cronbach's α coefficient >0.75 and high test–retest reliability (intraclass correlation coefficient, 0.75). Content validity analysis showed the item-content validity index of ≥0.90 for all WIPS items, confirming 100% of the hypotheses for testing construct validity. Confirmatory factor analysis showed an acceptable fit for the hypothesized six-factor construct (CFI = 0.92, TLI = 0.91, RMSEA = 0.07, SRMR = 0.05). ConclusionsThe WIPS was found to be a valid and reliable instrument. With the growth of the elderly population worldwide, we believe that the WIPS will be a useful quantitative measure to assess workplace interpersonal problems affecting care workers in various aspects.

The development and validation of the Discrimination and Stigma Scale Ultra Short for People Living with Dementia (DISCUS-Dementia).

The recent World Health Organization (WHO) blueprint for dementia research and Lancet Commission on ending stigma and discrimination in mental health has identified a gap around dementia-related measures of stigma and discrimination that can be used in different cultural, language and regional contexts. We aimed to characterise experiences of discrimination, and report initial psychometric properties of a new tool to capture these experiences, among a global sample of people living with dementia. We analysed data from 704 people living with dementia who took part in a global survey from 33 different countries and territories. Psychometric properties were examined, including internal consistency and construct validity. A total of 83% of participants reported discrimination in one or more areas of life, and this was similar across WHO Regions. The exploratory factor analysis factor loadings and scree plot supported a unidimensional structure for the Discrimination and Stigma Scale Ultra Short for People Living with Dementia (DISCUS-Dementia). The instrument demonstrated excellent internal consistency, with most of the construct validity hypotheses being confirmed and qualitative responses demonstrating face validity. Our analyses suggest that the DISCUS-Dementia performs well with a global sample of people living with dementia. This scale can be integrated into large-scale studies to understand factors associated with stigma and discrimination. It can also provide an opportunity for a structured discussion around stigma and discrimination experiences important to people living with dementia, as well as planning psychosocial services and initiatives to reduce stigma and discrimination.

Translation, cross-cultural adaptation and validation of the Italian version of the knee outcome survey − activities of daily living scale

PurposeThe Knee Outcome Survey - Activities of Daily Living Scale (KOS-ADLS) is a joint-specific questionnaire measuring symptoms and functional limitations experienced by individuals with painful knee disorders. The original version of the KOS-ADLS has been shown to be reliable, valid and responsive to change. The purpose of this study was to perform a translation and cross-cultural adaptation of the KOS-ADLS into Italian and to assess its reliability and validity. MethodsIn accordance with standard procedures, the original version of the KOS-ADLS was translated and cross-culturally adapted into Italian (KOS-ADLS-I). Then, the KOS-ADLS-I was administered to 150 patients with knee disorders. A subsample of patients compiled the KOS-ADLS-I again after five/seven days later to evaluate test–retest reliability. Symptoms and function-oriented questionnaires were also completed to evaluate construct validity. Structural validity (Explanatory Factor Analysis [EFA]), internal consistency (Cronbach's alpha), test-retest reliability (Intraclass Correlation Coefficient [ICC]), measurement error (Standard Error of the Measurement [SEM], Minimal Detectable Change [MDC]), and construct validity (hypothesis testing) were assessed. ResultsThe cross-cultural adaptation procedure revealed no major problems. EFA revealed a unidimensional structure. Internal consistency was high (Cronbach's alpha = 0.976) and the test–retest reliability was excellent (ICC = 0.990, 95%CI: 0.980–0.995) with low measurement error (SEM = 2.6 points; MDC = 7.1 points). The construct validity resulted to be satisfactory, as 100% a-priori hypothesis were met. ConclusionsThe KOS-ADLS-I is a reliable and valid questionnaire for the assessment of symptoms and functional limitations in individuals with musculoskeletal knee disorders and it can be used in clinical practice and research.

Construct validity of the Single Arm Military Press (SAMP) test for upper limb function in patients with neck pain

BackgroundNeck pain (NP) is often associated with upper limb disability (ULD). A clinically feasible measure to evaluate ULD in NP patients is necessary. The Single Arm Military Press (SAMP) is a ULD performance-based measure, specifically for NP patients. The validity of the SAMP in patients is still unknown. ObjectiveTo explore the construct validity (hypotheses testing) of the SAMP in NP patients. MethodsA total of 210 NP patients and 81 controls were recruited. The SAMP; Disability of the Arm, Shoulder, and Hand (DASH); and Neck Disability Index (NDI) were completed at baseline and 4–7 days later. The Visual Analogue Scale (VAS) was used to measure NP and ULD severity pre-testing in both occasions. Patients were divided into 4-subgroups based on their NDI score. Convergent validity was examined using Pearson correlation. The t-test and analysis of variance (ANOVA) were used to evaluate discriminant and known groups’ validity. To determine SAMP cut-off scores, the sensitivity and specificity were explored. ResultsA negative correlation between the SAMP and DASH/NDI scores was found in the patient group (r = −0.91 and −0.87, p < 0.01). The t-test revealed substantial differences (t = −23.96) in score between patients and controls. Also, ANOVA revealed substantial differences (f = 20.86) between the patients’ subgroups. The area under the curve (AUC) for patients and controls exceeded 0.90 when sensitivity and specificity were at equal importance. ConclusionThe SAMP can distinguish between NP patients and controls, and between different NP disability levels. The responsiveness of the SAMP needs to be investigated.

Reliability, Validity, Responsiveness, and Minimum Important Change of the Stair Climb Test in Adults With Hip and Knee Osteoarthritis.

The Osteoarthritis Research Society International (OARSI) recommends assessment of physical function using a performance-based test of stair negotiation but was unable to recommend any specific test. We assessed the reliability, validity, responsiveness, measurement error, and minimum important change (MIC) of the 6-step timed Stair Climb Test (SCT). We used pooled data from 397 participants with hip or knee osteoarthritis (54% women) from 4 clinical trials (86% retained at 12-week follow-up). Construct validity was assessed by testing 6 a priori hypotheses against other OARSI-recommended physical function measures. A self-reported Global Rating of Change scale was used to classify participants as worsened, improved, and stable. Participants who worsened in physical function were excluded from all analyses. Responsiveness and MIC were assessed using multiple anchor-based and distribution-based approaches. Test-retest reliability, standard error of measurement (SEM), and smallest detectable change (SDC) were assessed on stable participants. Five of 6 hypotheses (83%) for construct validity were met. Test-retest reliability was excellent (intraclass correlation coefficient2,1 0.83; 95% confidence interval 0.71-0.90). The SEM and SDC values were 0.44 and 1.21 seconds, respectively. We did not find adequate support for responsiveness. The MIC values ranged from 0.78 to 1.95 seconds using different approaches (median 1.37 seconds). The 6-step timed SCT adequately assesses the construct of physical function in individuals with hip or knee osteoarthritis with excellent 12-week test-retest reliability. However, support for its responsiveness was inadequate to recommend its use as an outcome measure in people with osteoarthritis for research and clinical practice.

Measurement properties of the Dutch PROMIS-29 v2.1 profile in people with and without chronic conditions

PurposeTo investigate the structural validity, internal consistency, measurement invariance, and construct validity of the Dutch PROMIS-29 v2.1 profile, including seven physical (e.g., pain, physical function), mental (e.g., depression, anxiety), and social (e.g., role functioning) domains of health, in a Dutch general population sample including subsamples with and without chronic diseases.MethodsThe PROMIS-29 was completed by 63,602 participants from the Lifelines cohort study. Structural validity of the PROMIS-29, including unidimensionality of each domain and the physical and mental health summary scores, was evaluated using factor analyses (criteria: CFI ≥ 0.95, TLI ≥ 0.95, RMSEA ≤ 0.06, SRMR ≤ 0.08). Internal consistency, measurement invariance (no differential item functioning (DIF) for age, gender, administration mode, educational level, ethnicity, chronic diseases), and construct validity (hypotheses on known-groups validity and correlations between domains) were assessed per domain.ResultsThe factor structure of the seven domains was supported (CFI = 0.994, TLI = 0.993, RMSEA = 0.046, SRMR = 0.031) as was unidimensionality of each domain, both in the entire sample and the subsamples. Model fit of the physical and mental health summary scores reached the criteria, and scoring coefficients were obtained. Cronbach’s alpha for the seven PROMIS-29 domains ranged from 0.75 to 0.96 in the complete sample. No DIF was detected. Of the predefined hypotheses, 78% could be confirmed.ConclusionSufficient structural validity, internal consistency and measurement invariance were found, both in the entire sample and in subsamples with and without chronic diseases. Requirements for sufficient evidence for construct validity were (almost) met for most subscales. Future studies should investigate test–retest reliability, measurement error, and responsiveness of the PROMIS-29.

Psychometric performance of the Arabic versions of the Functional Assessment of Cancer Therapy-Breast plus Arm morbidity (FACT-B + 4) in patients with breast cancer related lymphedema: cross-sectional study

BackgroundBurden of breast cancer it continues to increase largely because of the aging and growth of the world population and assessment of quality of life is an important outcome measure to facilitate and improved care among breast cancer survivors, the aim of this study was to evaluate evidence of reliability, validity, and responsiveness of the Arabic version of the FACT-B + 4 questionnaire among participants with breast cancer related lymphedema (BCRL) in Saudi Arabia.MethodsA prospective cross-sectional study, 51 participants with BCRL completed the Arabic version of FACT-B + 4. Internal consistency and test–retest-reliability were assessed using Cronbach’s alpha, intraclass correlation-coefficient (ICC), and limits of agreement according to the Bland Altman method, respectively. The validation studies were carried-out by examining predefined hypotheses (n = 14) for both construct and Known-groups validity. To investigate the responsiveness, the Arabic version of FACT-B + 4 questionnaire was administrated preoperative and 4 weeks postoperatively among the participants with breast cancer (n = 34).ResultsThe Cronbach alpha of the Arabic FACT-B + 4 total score was 0.90 and for the different subscales ranged from 0.74 to 0.89. Test–retest reliability for FACT-B + 4 total score and different subscales was found to be moderate to very strong (ICC 0.51–0.94). The Bland–Altman plot was adequate − 19.24 and 22.10 points. Measurement variability was acceptable for Arabic FACT-B + 4 and ARM subscale (standard error of measurement = 5.34, and 1.34). Moderate correlations (r = 0.42–0.62) were found between the subscale of the FACTB + 4 and the corresponding domains of SF-36. For known group validity, 72% (10 of 14) hypotheses on known group validity were accepted.ConclusionFACT-B + 4 has adequate psychometric properties, thus making it useful for assessing QOL quality of life in Arabic speaking women with BCRL.

Turkish Version of the Working Memory Questionnaire: Reliability and Validity

Purpose: The aim of this study was to develop the Turkish version of the Working Memory Questionnaire (WMQ-TR) and to examine the reliability and validity of the adapted version. Methods: The translation of the questionnaire was undertaken according to the international guidelines. The participants received an online survey including WMQ-TR and the Turkish Version of the Cognitive Failure Questionnaire (CFQ-TR). At two weeks after the first administration of the survey, the participants were asked to complete WMQ-TR again to examine test-retest reliability. Internal consistency (Cronbach's alpha coefficient) and construct validity (hypothesis testing) analyses were used to evaluate validity. The intra-class correlation coefficient (ICC) was used to determine test-retest reliability. Results: The study was conducted with 303 healthy participants. The test-retest reliability of WMQ-TR was high (ICC=0.91, p&amp;lt;0.001), and Cronbach’s alpha was 0.90. A moderate positive correlation was found between WMQ-TR and CFQ-TR (r=0.61, p&amp;lt;0.001). Conclusion: WMQ-TR appears to have excellent test-retest reliability, acceptable construct validity, and good internal consistency.

Measurement properties of the EQ-5D-Y administered through a smartphone app in children with asthma: a longitudinal questionnaire study

BackgroundAsthma impacts children’s physical, emotional, and psychosocial Health-Related Quality of Life (HRQL). The EQ-5D-Y is a generic econometric instrument developed to measure HRQL in children.ObjectiveEvaluation of feasibility, validity, reliability, and responsiveness of EQ-5D-Y descriptive system and utility index to allow the assessment of HRQL in children with asthma, aged 8–11 years (self-response version) or under 8 years old (proxy-response version).MethodsWe used data from baseline to 10 months of follow-up of an observational, prospective study of children with persistent asthma recruited by pediatricians in Spain (2018–2020). HRQL instruments were administered through a smartphone application: ARCA app. The EQ-5D-Y is composed of a 5-dimension descriptive system, a utility index ranging from 1 to − 0.5392, and a general health visual analogue scale (EQ-VAS). The Pediatric Asthma Impact Scale (PROMIS-PAIS) includes 8 items, providing a raw score. Construct validity hypotheses were stated a priori, and evaluated following two approaches, multitrait–multimethod matrix and known groups’ comparisons. Reliability and responsiveness subsamples were defined by stability or change in EQ-VAS and the Asthma Control Questionnaire (ACQ), to estimate the intraclass correlation coefficient (ICC) and the magnitude of change over time.ResultsThe EQ-5D-Y was completed at baseline for 119 children (81 self-responded and 38 through proxy response), with a mean age of 9.1 (1.7) years. Mean (SD) of the EQ-5D-Y utility index was 0.93 (0.11), with ceiling and floor effects of 60.3% and 0%, respectively. Multitrait–multimethod matrix confirmed the associations previously hypothesized for the EQ-5D-Y utility index [moderate with PROMIS-PAIS (0.38) and weak with ACQ (0.28)], and for the EQ-5D-Y dimension “problems doing usual activities” [moderate with the ACQ item (0.35) and weak with the PROMIS-PAIS item (0.17)]. Statistically significant differences were found in the EQ-5D-Y between groups defined by asthma control, reliever inhalers use, and second-hand smoke exposure, with mostly moderate effect sizes (0.45–0.75). The ICC of the EQ-5D-Y utility index in the stable subsamples was high (0.81 and 0.79); and responsiveness subsamples presented a moderate to large magnitude of change (0.68 and 0.78), though without statistical significance.ConclusionsThese results support the use of the EQ-5D-Y as a feasible, valid, and reliable instrument for evaluating HRQL in children with persistent asthma. Further studies are needed on the responsiveness of the EQ-5D-Y in this population.

Assessing physical workload among people with musculoskeletal disorders: validity and reliability of the physical workload questionnaire

BackgroundDemands of physical work are related to musculoskeletal disorders, and hence, important to assess. The Physical Workload Questionnaire (PWQ) is based on 26 items related to physical workload. The PWQ has been translated into Norwegian, but its psychometric properties have not yet been tested. The aim of this study was to assess the validity and reliability of the PWQ among patients with musculoskeletal disorders.MethodsA cross-sectional study with a test-retest design was conducted to assess construct validity (structural validity and hypothesis testing) and reliability (internal consistency and test-retest reliability) among employed patients with musculoskeletal disorders. Exploratory factor analysis was performed to assess the structural validity and number of items to be included in the Norwegian version of the PWQ. Hypothesis testing was assessed by 14 a priori hypotheses (“known” group, convergent and discriminant validity). Internal consistency was evaluated using Cronbach’s alpha and test-retest reliability by Intraclass Correlation Coefficient (ICC2.1), Standard Error of Measurement (SEMagreement) and Smallest Detectable Change (SDC95%ind).ResultsIn total, 115 patients with a mean age (SD) of 46 (9) years were included, of which 48 were included in the reliability analyses. Exploratory factor analysis resulted in two subscales: “Heavy physical work” (15 items, range 0–100) and “Long-lasting postures and repetitive movements” (7 items, range 0–100). No floor or ceiling effects were seen in the subscales. Twelve of the 14 (85%) predefined hypotheses were confirmed. The internal consistency with Cronbach’s alpha was 0.94 and 0.85 on subscales 1 and 2, respectively. Test-retest reliability analyses demonstrated an ICC2.1 of 0.96 (95% CI 0.88, 0.98) and 0.92 (95% CI 0.81, 0.96), SEM of 6.9 and 10.0 and SDC95%ind of 19.2 and 27.7 of subscales 1 and 2, respectively.ConclusionsThe Norwegian version of the PWQ demonstrated good validity and reliability and can be used to evaluate physical workload in patients with musculoskeletal disorders.

Measurement Properties of the Polymyalgia Rheumatica Activity Score: A Systematic Literature Review.

To perform a COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN)-based systematic literature review of measurement properties of the Polymyalgia Rheumatica Activity Score (PMR-AS). PubMed, EMBASE, and CINAHL were broadly searched. English full-text articles, with (quantitative) data on ≥ 5 patients with PMR using the PMR-AS were selected. Seven hypotheses for construct validity and 3 for responsiveness, concerning associations with erythrocyte sedimentation rate, physical function, quality of life, clinical disease states, ultrasound, and treatment response, were formulated. We assessed the structural validity, internal consistency, reliability, and measurement error, or the hypotheses on construct validity or responsiveness of the PMR-AS based on COSMIN criteria. Out of the identified 26 articles that used the PMR-AS, we were able to use 12 articles. Structural validity, internal consistency, construct validity, and responsiveness were assessed in 1, 2, 8, and 3 articles, respectively. Insufficient evidence was found to confirm structural validity and internal consistency. No data were found on reliability or measurement error. Although 60% and 67% of hypotheses tested for construct validity and responsiveness, respectively, were confirmed, there was insufficient evidence to meet criteria for good measurement properties. While there is some promising evidence for construct validity and responsiveness of the PMR-AS, it is lacking for other properties and, overall, falls short of criteria for good measurement properties. Therefore, further research is needed to assess its role in clinical research and care.

Construct validity and responsiveness of the Duke Activity Status Index (DASI) as a measure of recovery after colorectal surgery.

Returning to preoperative levels of physical function is highly valued by patients recovering from surgery. The Duke Activity Status Index (DASI, a 12-item questionnaire) may be a simple yet robust tool to assess postoperative recovery of functional capacity. This study assessed construct validity and responsiveness of the DASI as a measure of recovery after colorectal surgery. Data from a trial on early mobilization after colorectal surgery were analyzed. Patients completed the DASI questionnaire preoperatively and at postoperative weeks (POW) 2 and 4. Construct validity was assessed by testing the primary a priori hypotheses that postoperative DASI scores (1) are higher in patients without vs with postoperative complications and (2) correlate with six-minute walk test distance (6MWD). Exploratory analyses assessed the association between DASI scores and (1) preoperative physical status [higher (ASA ≤ 2) vs lower (ASA > 2)], (2) stoma creation (no stoma vs stoma), (3) age [younger (≤ 75years) vs older (> 75years)], (4) time to readiness for discharge [shorter (≤ 4days) vs longer (> 4days)], and (5) surgical approach (laparoscopic vs open). Responsiveness was assessed by testing a priori hypotheses that DASI scores are higher (1) preoperatively vs at POW2 and (2) at POW4 vs POW2. Mean differences in DASI scores were obtained using linear regression. The association between DASI and 6MWD was assessed via Pearson correlation. We analyzed data from 100 patients undergoing colorectal surgery (mean age 65; 57% male; 81% laparoscopic). Mean DASI scores were 47.9 ± 12.1 preoperatively, 22.4 ± 12.7 at POW2, and 33.2 ± 15.7 at POW4. The data supported our two primary construct validity hypotheses, as well as 3/5 exploratory hypotheses. Both responsiveness hypotheses were supported. Our findings support that the DASI questionnaire can be a useful tool to assess postoperative recovery of functional capacity in research and clinical practice.

Content validity and measurement properties of the Lower Extremity Functional Scale in patients with fractures of the lower extremities: a systematic review

BackgroundFractures of lower extremities are common trauma-related injuries, and have major impact on patients' functional status. A frequently used Patient-Reported Outcome Measure (PROM) to evaluate patients’ functional status with lower extremity fractures is the Lower Extremity Functional Scale (LEFS). However, there is no systematic review regarding content validity and other measurement properties of the LEFS in patients with lower extremity fractures.MethodsA search was performed in PubMed, Embase, Scopus, and Cochrane Library from inception until November 2020. Studies on development of the LEFS and/or the evaluation of one or more measurement properties of the LEFS in patients with lower extremity fractures were included, and independently assessed by two reviewers using COSMIN guidelines.ResultsSeven studies were included. Content validity of the LEFS was rated 'inconsistent', supported by very low quality of evidence. Structural validity was rated ‘insufficient’ supported by doubtful methodological quality. Internal consistency, measurement error, and responsiveness were rated 'indeterminate' supported by inadequate to adequate methodological quality. The methodological quality of the construct validity (hypotheses testing) assessment was rated as 'inadequate'.ConclusionThe LEFS has several shortcomings, the lack of sufficient content validity being the most important one as content validity is considered the most crucial measurement property of a PROM according to the COSMIN guidelines. In interpreting the outcomes, one should therefore be aware that not all relevant aspects of physical functioning may be accounted for in the LEFS. Further validation in a well-designed content validity study is needed, including a clearly defined construct and patient involvement during the assessment of different aspects of content validity.Plain English summaryBone fractures of the lower extremities are a common injury. During rehabilitation it is essential to evaluate how patients experience their physical functioning, in order to monitor the progress and to optimize treatment. To measure physical functioning often questionnaires (also known as Patient Reported Outcome Measures) are used, such as the Lower Extremity Functional Scale (LEFS). However, it is not clear if the LEFS actually measures physical function, and if its other measurement properties are sufficient for using this questionnaire among patients with fractures in the lower extremities. Therefore, we systematically searched and assessed scientific papers on the development of the LEFS (i.e., its ability to measure physical functioning), and papers on the performance of the LEFS with regard to several measurement properties to identify possible factors that may cause measurement errors. Hereby we have assessed the quality of the studies included. Our main finding was that the LEFS may not measure all aspects of physical function. Given the low quality of the papers included in our study, these findings come with considerable uncertainty. As the LEFS was developed more than 20 years ago, it may not represent physical functioning as we currently conceptualize this. Therefore, we recommend to perform a study in which the content of the LEFS will be evaluated by experts in the field as well as patients, and modify the questionnaire as needed.